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A system of globally coupled phase oscillators subject to an external input is considered as 
a simple model of neural circuits coding external stimulus. The information coding efficiency 
of the system in its asynchronous state is quantified using Fisher information. The effect of 
coupling and noise on the information coding efficiency in the stationary state is analyzed. The 
relaxation process of the system after the presentation of an external input is also studied. It 
is found that the information coding efficiency exhibits a large transient increase before the 
system relaxes to the final stationary state. 
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^ ■ 1. Introduction 



Oscillatory activity of neurons is ubiquitous in vari- 
ous areas of the brain at various scales, whose physio- 
logical relevance to the information processing has been 
discussed in a number of studies. 1-4 In modeling cortical 
neural circuits, coupled oscillators have played important 
roles. 5:6 In this framework, the neurons are modeled as 
mutually interacting limit-cycle oscillators, where sim- 
plified interaction rules between the oscillators are often 
assumed for the sake of mathematical tractability. The 
case of global (all-to-all) coupling is typical of such sim- 
plified interactions, where the oscillators interact through 
the mean field of all oscillators. The prominent feature 
of globally coupled oscillators is complete synchroniza- 
tion. 5, 7-9 However, it is experimentally known that the 
cortical neurons in vivo rarely exhibit large-scale com- 
plete synchronization, but usually exhibit irregular firing 
patterns. 10 Therefore, it has been discussed how globally 
coupled models of neural populations can sustain asyn- 
chronous firing activity. 11-16 

It is generally considered that the cortical informa- 
tion processing is achieved through population coding, 
namely, collective representation of information by large 
numbers of neurons. 17-19 Regarding quantification of in- 
formation coding efficiency by a population of neurons, 
a framework based on statistical estimation theory has 
been utilized. In this framework, the information cod- 
ing efficiency is quantified by how precisely the given 
stimulus can be estimated from the observed firing rates 
of those neurons. It can be measured by the Fisher in- 
formation, which gives the accuracy of parameter esti- 
mation in statistical estimation theory. 20 ' 21 Using this 
framework, the information coding efficiency of various 
stochastic neuron models has been calculated. 17-19 

In this paper, instead of stochastic neuron models, we 
introduce a system of globally coupled phase oscillators 
as a simple model of cortical neural circuits. Our system 
exhibits asynchronous state where each oscillator rotates 
( "fires" ) independently, by which we model the "irregu- 
lar firing" of the cortical neurons. It codes the parameter 
value of an external input in the asynchronous phase dis- 
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tribution of the oscillators. We quantify the information 
coding efficiency of our system using the statistical esti- 
mation framework. We discuss the effect of coupling and 
noise on the information coding efficiency in the asyn- 
chronous stationary state. We also study the dynamical 
aspect of our system. Even if the oscillators are not in 
strict synchrony with each other, their population den- 
sity can still exhibit coherent damped oscillation. We 
show that such oscillation can lead to a large transient 
increase in the information coding efficiency. 



0m((pl,(p2, ...,(Pm) 

o 

(<Pl><P2, ...,<Pm) 




Fig. 1. Population coding by globally coupled phase oscillators. 
Information coding efficiency of the system is quantified using 
Fisher information, which gives the accuracy of an estimator 
6 m {tpi, ifim) of the external input parameter 9 from observed 
phase variables tp of the oscillators. 



2. Globally coupled phase oscillators 

We use a system of globally coupled phase oscillators, 
which was previously studied in detail by Golomb et al. 5 
It exhibits asynchronous states as well as various syn- 
chronized states. We set the system at its asynchronous 
state, and add a constant external input to the system 
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that depends on a given external parameter 9. This pa- 
rameter 9 is then coded by the non-uniform phase dis- 
tribution of the oscillators (Fig. 1). Our interest is how 
efficiently the population of the oscillators codes this ex- 
ternal parameter. We quantify it by how precisely we can 
estimate the given input by observing the phase variables 
of the oscillators. This system may be considered, for ex- 
ample, as a simple qualitative model of the orientation 
column in the visual cortex. 15-18 In that case, the ex- 
ternal parameter 9 corresponds to the angle of a visual 
directional stimulus. 
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Fig. 2. Snapshots of the phase ip of the oscillators at two values 
of the external input, 8 = 0o and 6 = 8g ± n. 



Our system consists of N identical phase oscillators 
mutually interacting through their mean field, which 
obey the following Langevin equations: 



dt' 



1 N 

<Pi(t) = f{<pi{t)) + - (*)) + & (t) + H{9) (1) 



for i = 1,...,N, where pi represents the phase of the i-th 
oscillator, f((p) = A + sin ip the individual dynamics of 
an isolated oscillator, g(p) = C sm(tp+a) the interaction 
between the oscillators, and & a Gaussian-white noise 
with zero mean, whose correlation function is given by 
= 2DS (t - t')Sij. We identify <p + 2irk (k is 
an integer number) with ip and restrict the value of p in 
[— 7r,7r]. H{9) is a ^-dependent constant external input 
common to all oscillators, which we explain below. The 
parameter A determines the dynamics of each oscillator, 
C the coupling strength, a the phase shift of coupling, 
and D the intensity of noise. We assume that C can take 
both positive and negative values, and the range of a 
to be (0, 7r). We exclude two extreme values a = and 
a = ir, since the system becomes singular with these 
values. 5 

When isolated, each oscillator exhibits both excitatory 
and self-oscillatory dynamics depending on the value of 
A (without the noise and the external input, each oscil- 
lator is self-oscillatory when A > 1). To realize the asyn- 
chronous state, we set A at a sufficiently large value, so 
that each oscillator is self-oscillatory even if the effects 
of the coupling, the noise, and the external input are 



incorporated. In this self-oscillatory situation, the mean 
rotation rate (or the "firing rate") of the oscillator in- 
creases with A. 

Through the external input H(9), the dynamics of the 
phase (p is affected by the external parameter 9. We as- 
sume the range of 9 to be [— n, ir] ("angle stimulus") and 
use a functional form H(9) = Hq cos(9 — 9q) as the ex- 
ternal input, where H determines its strength and 9 
the location of its maximum ( "preferred stimulus" ) . This 
H{9) roughly models the one-humped "tuning curve", 
which represents the response of a neuron to the stimu- 
lus. 17-19 When 9 approaches 6>o, the mean rotation rate 
of the oscillators increases, and reaches the maximum 
value at 9 = 9o (in the following discussion, the results 
depends only on the difference 9 — 9q,so that the absolute 
value of #o is not important). Since this external input 
H{9) merely shifts the parameter A in the individual dy- 
namics of the oscillator f(ip) = A + sinp, we hereafter 
include H(9) in A and denote the effective value of A as 
A{6) = A + H{6). 

Figure 2 displays two snapshots of the phase <pi of all 
oscillators in the asynchronous stationary state obtained 
by direct numerical simulations of the Langevin equa- 
tions (1) at two different values of the external input, 
9 = 6q and 9 = 9q ± it (9 = 9o + n and 9o — n give the 
same external input because H{9) is periodic in 9). The 
other parameters are fixed at A = 1.5, C = 0.5, a = 7r/4, 
Hq =0.1, and D = 0.1. It can be seen that the distri- 
bution of the phase is relatively uniform at the preferred 
input 9 = 6q, whereas its non- uniformity is enhanced at 

9 = 9 ± 7T. 

Hereafter, rather than tracking the individual stochas- 
tic trajectories of the oscillators directly, we take the 
TV — > oo limit and consider the one-body probability 
density function (PDF) P(ip, t; 9) of the phase <p. The 
evolution of the PDF P(ip,t;9) is described by 5 - 7 - 8 



d_ 

dt 



P(tp,t;0) 



d_ 

dip 



I{ip,t; 



I{<p,t;6) = {A{9) + G(t;6)+ sin <p} P{<p,t; 9) 



- D ip- p ^< 



(2) 



where I(tp, t; 9) represents the probability flux, and 
G(t; 9) the "internal field" defined as the interaction 
function averaged by the PDF P(p,t;6), i.e., 



G(t 



;<?)= r 

J —IT 



P(cp, t; 6)C sin(<^ + a) dtp. 



(3) 



Periodic boundary conditions are assumed for P(p,t;9) 
and I(tp, t; 9) at p = ±tt. 

Figure 3 displays stationary PDFs of the phase 
Po (<p; 9) at several values of the external parameter 9 
in the asynchronous stationary state, which corresponds 
to Fig. 2. The details of this state will be given in the 
next section. The PDF is relatively uniform at the pre- 
ferred input 9 = 6*o, and becomes steeper at 9 = 9 ± ir. 
At this weak noise level, D = 0.1, functional shape of the 
PDF is close to that in the noiseless case. As the value of 
9 is varied, the shape of Po(<p;9) varies correspondingly. 
In other words, the external parameter 9 is coded by the 
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Fig. 3. Stationary PDF Po(ip:9) at several values of the external 
parameter 9 (9 = 9 ± tt, 6 = 9q ± tt/2, and 9 = 9 ). 



stationary PDF in the asynchronous state of our globally 
coupled phase oscillators. 

3. Asynchronous stationary state 

In this section, we summarize the dynamics of Eqs. (2) 
and (3) following Golomb et al. 5 with emphasis on the 
asynchronous stationary state. The PDF P(<p, t; 9) ex- 
hibits mainly three behavior, namely, fixed state, limit- 
cycle state, and asynchronous stationary state. The prob- 
ability flux I(ip, t; 9) takes a small value in the fixed state 
(zero in the noiseless case), a non-zero constant value in 
the asynchronous stationary state, and oscillates period- 
ically in the limit-cycle state. 

Let us consider the noiseless case (D = 0) first. In this 
case, existence and linear stability of each state can be 
studied analytically. 5 Here, it should be noted that even 
if we set D — 0, we always assume that the system is 
subject to infinitesimally weak noise, to avoid singular 
behavior specific to the noiseless equation and to ensure 
the existence of final steady states. 8 With this under- 
standing, we formally set D = to facilitate analytical 
treatment, and compare the analytical results with the 
numerical simulations at finite values of D. 

The fixed-state solutions exist when C 2 +2C cos a+1 > 
A(9) 2 , and the stability conditions are given by C cos a > 
-1 + A(d) or by Ccosa > -1-A(6) and C > 0. In this 
state, all oscillators take the same fixed phase homoge- 
neously, and the PDF is simply a 5-function with fixed lo- 
cation. The probability flux is constantly zero. The limit- 
cycle solution exists when C 2 + 2Ccosa + l < A(9) 2 , and 
is stable when C > 0. In this state, the oscillators exhibit 
completely synchronized rotation. The PDF is again a 5- 
function, whose location rotates steadily. The temporal 
sequence of the probability flux is given by periodically 
aligned ^-functions. 

In our context, these two states are inappropriate for 
modeling the dynamics of cortical neurons. In the fixed 
state, all oscillators are trapped to the same fixed phase 
and never rotate, namely, the neurons do not fire at all. 
On the other hand, the limit-cycle state corresponds to 
the completely synchronized firing of all neurons, which 
is experimentally unrealistic. These situations are not 
changed even if weak noise is introduced. Only with suffi- 



ciently strong noise, these states may be utilized in mod- 
eling the dynamics of cortical neurons, but we do not 
consider such cases in this paper for simplicity. 

The asynchronous stationary solution exists when 
—oo < Ccosa < [A(9) 2 - 1]/2. It coexists with the limit- 
cycle or fixed solution. Unlike the above two cases, the 
PDF takes a broad functional form in this state. The 
oscillators are not in synchrony with each other, and ro- 
tate with a finite constant rate steadily. The probability 
flux I{4>, t; 9) takes a constant value, which is typically 
between 0.05 and 0.20 at the parameter values we use 
in this paper. The stationary PDF Po(<p; 9) in the asyn- 
chronous stationary state at D = can be obtained from 
Eqs. (2) and (3) as 



Po(<p;0) 



[no? 



1 



1 



2vr 



(4) 



F{9) + sin ip' 

Here, F{9) is defined as F{9) = A{9) + G (9), where 
Go (6) denotes the internal field in this stationary state. 
The value of Gq(9), or equivalently the value of F(0), is 
determined self-consistently so that Go(9) and Po(ip;9) 
satisfy Eq. (3). It is explicitly calculated as 

1 



F{9) 



1 + 2Ccosa 



{(1 + C cos a) A(S) 



) 2 [A{9) 2 - (l + 2Ccosa)]}.(5) 



± \J (Ccosa 

When C = or a = 7r/2 (Ccosa = 0), we obtain 
a trivial solution F{9) = A{9), i.e., G (9) = 0. The 
relevant solution for Ccosa ^ is given by the nega- 
tive branch when — oo < Ccosa < 0, and by the pos- 
itive branch when < Ccosa < [A(9) 2 - l]/2. When 
Ccosa > [^4(#) 2 — l]/2, no stationary PDF exists that 
corresponds to the asynchronous stationary state. 
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Fig. 4. Phase diagram of the system at A = 1.4. Region "A" rep- 
resents the asynchronous stationary state, "L" the limit-cycle 
state, and "S" the fixed state. In the small region "A+S", the 
asynchronous state and the fixed state are bistable, and in the re- 
gion "L+S" , the limit-cycle state and the fixed state are bistable. 
The dotted curve distinguishes the regions "A" and "S" as de- 
fined in the text. 



For example, when < a < 7r/2, the non-uniformity of 
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Po(<p; 9) is enhanced as we increase C, because F(9) de- 
creases. However, as we increase C further, C cos a even- 
tually reaches [A(9) 2 — 1]/2, and the stationary PDF cor- 
responding to the asynchronous stationary state ceases 
to exist. We arc then left with a (5-peaked stationary PDF 
that corresponds to the fixed state of the oscillators. 

According to the linear stability analysis of the sta- 
tionary PDF, 5 Pq(<p\ &) is marginally stable when C < 0, 
and is unstable when C > in the absence of noise. 
Therefore, when C > 0, the asynchronous stationary 
state cannot be realized without noise, and only the fixed 
or limit-cycle state is observed in numerical simulations. 

When the noise exists (D > 0), the functional form 
of the stationary PDF becomes complex. However, we 
can still obtain it numerically by finding the station- 
ary solution of Eqs. (2) and (3). The (5-peaked PDF in 
the fixed or limit-cycle state at D = is smeared by 
the noise, and takes broader functional form. The asyn- 
chronous stationary state is also broadened by the noise. 
Furthermore, the noise also stabilizes the asynchronous 
stationary state, 5 so that originally only marginally sta- 
ble PDF at C < becomes linearly stable whenever 
D > 0, and even the originally unstable asynchronous 
stationary state at C > can be stabilized when D > D c , 
where D c is a certain critical noise intensity that depends 
on C. 

Figure 4 displays a numerically obtained phase dia- 
gram of our system, where the final steady state of the 
system sufficiently after the initial transient is indicated 
as a function of the coupling strength C and the noise 
intensity D. The parameter A(9) is fixed to its minimum 
value, A(9 = 9q ± tt) = A — Ha = 1.4, because the stabil- 
ity region of the asynchronous stationary state, which is 
of our primary interest, becomes smallest at this value. 
As can be seen, originally unstable asynchronous station- 
ary state for C > can easily be stabilized as D becomes 
larger than a certain small critical value D c . 

In region "A" of the phase diagram, the PDF ex- 
hibits stable asynchronous stationary state, which con- 
tinues from the marginally stable (C < 0) or unstable 
(C > 0) asynchronous solution at D = 0. In region "L", 
the PDF exhibits limit-cycle oscillation, which is the con- 
tinuation of the completely synchronous limit-cycle solu- 
tion at D = 0. In region "S", the PDF exhibits fixed 
stationary state with small probability flux, which con- 
tinues from the homogeneous fixed solution at D = 0. 
There also exist small bistable regions where the fixed 
state coexists with the asynchronous stationary state or 
with the limit-cycle state at small noise intensity, roughly 
D < 0.07, as indicated in the figure as "A+S" or "L+S". 
As D becomes larger than 0.07, the bistable region van- 
ishes, and the distinction between the asynchronous sta- 
tionary state and the fixed state becomes unclear. We 
therefore distinguish the asynchronous stationary state 
"A" from the fixed state "S" by whether the probability 
flux I(ip,t;9) exceeds 0.05 or not when D > 0.07. Here, 
the value 0.05 is determined using the probability flux at 
the upper endpoint of the bistable region "A+S". The 
boundary between "A" and "S" determined in this way 
is displayed in the figure by the dotted curve. As we cross 
this boundary from region "A" to "S" , the PDF changes 



its shape and the probability flux drops quickly. Here- 
after, we restrict our analysis to the asynchronous sta- 
tionary state "A" with sufficiently large probability flux. 
The fixed state, the limit-cycle state, and the bistable 
regions are excluded from our consideration. 

4. Fisher information 

Let us quantify the information coding efficiency of our 
system using Fisher information. We consider the accu- 
racy of the parameter estimation of 9 from m samples 
of the phase ip±, ip m observed independently from the 
^-dependent PDF P(ip;9). According to the statistical 
estimation theory, 20,21 the maximum likelihood estima- 
tor 9 m ((pi, </2 m ), which is determined so as to maximize 
the likelihood function L(9; (p%, (p m ) = JlfcLi P(<Pk',9), 
weakly converges to a normal distribution with mean 9 
and variance l/mJ(9) in the limit of large m. The quan- 
tity J(9) in the denominator of the variance is the Fisher 
information, which is defined as 



J(9) 



|logP(^; 



1 2 



dtp. 



(0) 



Under some regularity conditions, the maximum likeli- 
hood estimator is proven to be asymptotically optimal in 
the large m limit, in the sense that asymptotic variance 
of all other asymptotically normal estimators cannot be 
smaller than \/mJ(9). 20 > 21 Thus, the Fisher information 
J{9) gives a lower bound to the error of parameter esti- 
mation, and it can be considered as quantifying the infor- 
mation (actually parameter) coding efficiency of the sys- 
tem by its PDF. As can be seen from Eq. (6), J (9) mea- 
sures the mean "response" of the PDF P(tp; 9) to a slight 
change in the parameter 9. When this response is large, 
the estimation error becomes small, and the information 
coding efficiency becomes large. The Fisher information 
can also be related to the discriminability measure be- 
tween two similar stimuli used in psychophysics. 17, 18 
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Fig. 5. Fisher information J(8) obtained for the uncoupled case 
(C = 0) and for the coupled cases (C = ±0.5). Cosine curve in 
the lower part is the external input ("tuning curve") H(9) given 
to the system (rescaled and shifted). 



5. Stationary information coding efficiency 

We first consider the information coding efficiency in 
the stationary state of our system. In the absence of noise 
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(D = 0), we can analytically calculate the Fisher in- 
formation J(ff) from the self-consistent stationary PDF 
Po(ip-,e), Eq. (4), as 



AO) = \ 



dF{9) 



Of) 



[F(ey iy 



(7) 



Since F{9) contains the self-consistent internal field 
Go(0), J (9) depends on the mutual coupling through 
this quantity. By substituting the explicit form of F(6), 
Eq. (5), we can express J{9) in terms of A{9) = A + H(9) 
and Ccosa. When D > 0, we can calculate J(9) using 
numerically obtained stationary PDFs. With the weak 
noise we use in this paper, the numerically obtained 
Fisher information for D > is close to the noiseless 
theoretical values at D = 0. 

Figure 5 displays the Fisher information J(9) obtained 
for the uncoupled case (C = 0) and for the coupled cases 
(C = ±0.5) as a function of the external parameter 9. 
The other parameters are fixed at A — 1.5, a = 7r/4, 
Hq = 0.1, and D = 0.1. The Fisher information clearly 
depends on the coupling strength C; we attain much 
larger value at C = 0.5 than at C = or C = —0.5. 
At this noise level, the numerically obtained Fisher in- 
formation is close to the noiseless theoretical values. Note 
here that the asynchronous stationary state is unstable 
without the noise when C > 0, so that the correspond- 
ing theoretical values of the Fisher information cannot 
be attained in practice. However, as can be seen from 
Fig. 4, the weak noise (D = 0.1) can readily stabilize the 
originally unstable PDF at C > and helps realize much 
larger information coding efficiency. 



0.25 




Fig. 6. Dependence of the mean Fisher information J a on the 
coupling strength C. At D = 0, only the region indicated by the 
arrow can be realized. Crosses represent the values of C where 
the asynchronous stationary state disappears (D = 0) or gives 
way to the stationary fixed state (D = 0.1, D = 0.2). 



Since our external input H (9) takes its maximum value 
at 9 = 6q, the mean rotation rate of each oscillator is also 
maximized at this value. However, J(9) vanishes at this 
point, because 9 = 9q is the extremum of A(9), hence 
OF 1 09 (x OA/ 09 — holds. Thus, accurate parameter 
estimation is difficult around 9 = 9q. Rather, J (9) takes 
its maximum at 9 ~ ±7r/2, where the functional shape of 



the stationary PDF most strongly depends on the exter- 
nal parameter 9. This fact is consistent with the results 
in the previous studies, 1 which is interesting since it 
is against our rate-coding intuition. 

In Fig. 6, the dependence of the mean Fisher informa- 
tion J a = (27r) _1 J(9)d9 on the coupling strength C 
is displayed at three values of the noise intensity, D = 0, 
D = 0.1, and D = 0.2. When D = 0, only the region 
C < as indicated in the figure is realizable. How- 
ever, when D = 0.1 or 0.2, originally unstable PDF for 
C > is stabilized as shown in Fig. 4, so that the whole 
curve can be realized. J a increases remarkably as C is 
increased, because the non-uniformity of the stationary 
PDF is enhanced, and its dependence on the parameter 
9 becomes stronger. 




Fig. 7. Dependence of the mean Fisher information J a on the 
noise intensity D. At D = 0, only the region indicated by the 
arrow can be realized. 



If C is further increased to a certain critical value, the 
stationary PDF corresponding to the asynchronous sta- 
tionary state disappears (D = 0) or gives way to the fixed 
state with low probability flux [D = 0.1, D = 0.2). These 
values are indicated by crosses in the figure. The Fisher 
information diverges at this point when D = 0, because 
the stationary PDF changes its functional form discon- 
tinuously. When D — OA and D = 0.2, divergence of 
the Fisher information is suppressed, but it still exhibits 
abrupt increase due to the sudden change in the sta- 
tionary PDF. Although this result is formally valid, such 
divergent behavior indicates the failure of our present 
framework based on the Fisher information in quanti- 
fying the information coding efficiency around bifurca- 
tion points; it implies that we can estimate the exter- 
nal parameter with infinite precision even from a sin- 
gle observation. This is due to the basic assumption of 
our framework, namely, continuous dependence of the 
functional shape of the PDF on the external parame- 
ter, which is generally violated at the bifurcation points. 
Thus, at present, we consider the divergent behavior of 
the Fisher information around the bifurcation point as 
rather a mathematical artifact. In conventional studies of 
the information coding efficiency using stochastic neuron 
models, 17-19 the firing statistics of the neurons is usually 
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assumed to be given by some specific family of the PDF, 
e.g. Gaussian or Poissonian, so that such a situation does 
not arise generally. 

Figure 7 displays the dependence of the mean Fisher 
information J a on the noise intensity D at three values 
of the coupling strength, C = —0.5, C = 0, and C = 0.5. 
The other parameters are fixed at A = 1.5, a = 7r/4, 
and Hq =0.1. As previous, the asynchronous stationary 
state is unstable at small D when C = 0.5, and only 
the region indicated by the arrow in the figure can be 
realized. As we increase D, J a decreases. The noise gen- 
erally decreases the information coding efficiency of the 
system, because the noise tends to flatten the stationary 
PDF and weakens its dependence on 9. However, inter- 
estingly, the mean Fisher information J a corresponding 
to C = 0.5 takes its maximum value not at D = but 
at a small but finite value of D, as shown in the inset of 
Fig. 7 (the asynchronous stationary state is already sta- 
bilized at this value of D). Thus, the noise is generally 
disturbing, but it can also help the realization of larger 
information coding efficiency 
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Fig. 8. Snapshots of Fisher information J (6, 1) at several mo- 
ments in the relaxation process after the onset of the external 
input. 



6. Dynamic information coding efficiency 

Since our system is a stochastic dynamical system, we 
can consider not only its stationary state, but also its 
non-stationary state. We here briefly study the relaxation 
process after the presentation of an external input. Let 
us assume that the system is in its initial asynchronous 
stationary state without any external input when t < 0. 
After t — 0, we apply a constant external input H{9) 
to the system and observe its relaxation to a new asyn- 
chronous stationary state determined by the given pa- 
rameter 9. By solving the evolution equation (2) of the 
PDF P((f, i; 9) numerically, we can calculate the Fisher 
information J(9,t) at any moment. 

Figure 8 shows several snapshots of J(9, t) during 
the relaxation process, and Figure 9 shows tempo- 
ral variation of the mean Fisher information Ja(^) = 
(27r) _1 J(9,t)d9. The system parameters are A = 
1.5, a = tt/4, C = 0.5, H a = 0.1, and D = 0.1. Inter- 
estingly, slightly after the onset of the external input, 
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Fig. 9. Temporal variation of mean Fisher information Ja(*) af- 
ter the onset of the external input. 

J{9, t) exhibits wavy functional shape that is consider- 
ably different from the previously obtained stationary 
functional shape, and then it gradually converges to the 
stationary shape. Correspondingly, after the onset of the 
external input, JA(t) rapidly increases from zero to a 
certain maximum value and then exhibits an oscillatory 
relaxation to the new stationary value. 

This reflects the fact that the dependence of the tran- 
sient PDF P((f, t; 9) on 9 is much stronger than that 
of the stationary PDF Po(ip;9), which can be qualita- 
tively understood as follows. When we apply a constant 
external input H(9), the PDF undergoes oscillatory re- 
laxation to the new stationary state, with the period of 
the oscillation determined by the parameter 9. In this 
process, the discrepancy of two PDFs corresponding to 
two slightly different values of 9 becomes much larger 
than that in the stationary state, through a mechanism 
essentially similar to the "beat" of sound waves. As a 
result, the Fisher information, which measures the mean 
response of the PDF to a slight change in the param- 
eter, also increases remarkably and exhibits a transient 
increase in information coding efficiency 

7. Summary 

We considered population coding of an external pa- 
rameter in the asynchronous state of globally coupled 
phase oscillators and quantified its information coding 
efficiency using Fisher information. The Fisher informa- 
tion depends on the mutual coupling through the self- 
consistent internal field of the oscillators. The noise gen- 
erally reduces the Fisher information of the system, but it 
also stabilizes the originally unstable PDF and helps real- 
ize larger information coding efficiency. We found a sub- 
stantial transient increase in Fisher information slightly 
after the onset of an external input, before the system 
relaxes to a new stationary state. 

Although we treated the information coding only in 
the asynchronous state in this paper, the fixed or limit- 
cycle state with sufficiently strong noise may also be con- 
sidered as the basis for the information coding. It would 
then be interesting to compare the information coding 
efficiency among those dynamically distinct situations. 
However, as we saw in Fig. 6, our framework based on 
Fisher information does not yield practically meaning- 



J. Phys. Soc. Jpn. 



Full Paper. 



Author Name 7 



ful result around the bifurcation point between different 
dynamical states. To remedy this situation, further mod- 
ifications to our present framework will be necessary. 

The transient increase in Fisher information indicates 
that the extraction of the information stored in our sys- 
tem can be better achieved in the transient state than 
in the final stationary state. Though our present system 
is only a rough caricature of real cortical networks, the 
mechanism leading such behavior can be generic. Thus, it 
could provide an interesting viewpoint on the role played 
by the transient dynamical behavior of the population of 
real cortical neurons, e.g. in interpreting the results of 
psychophysical experiments. 

In any case, to assert the relevance of our physical find- 
ings in the actual information processing by the cortical 
neurons, we need careful discussions on the physiologi- 
cal plausibility of the model. A more detailed analysis of 
the present system and generalization to more realistic 
neural models will be reported in the future. 

Finally, from a general viewpoint, our analysis re- 
ported in this paper can be considered as a prototypical 
study of physical systems coding external information. 
Such a framework would be important in analyzing phys- 
ical systems that process external information, not only 
in the context of neuroscience but also in various other 
areas. 
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